SCREEN RASTER GENERATION VIA 
PROGRAMMABLE LOOKUP TABLES 

BACKGROUND OF THE INVENTION 

5 1 . Field of the Invention 

This invention relates to the field of video processing, and in particular to a system for 
generating screen raster signals, based on parameters contained in a programmable lookup table. 

2. Description of Related Art 

10 As competing technologies are developed for video displays, and in particular television 

displays, differing standards have been promulgated. For example, conventional televisions in 
the United States conform to the 'NTSC 1 standard, while televisions in other countries may 
conform to the 'SEC AM 1 or 'PAL standards. As the high-definition television (HDTV) 
technologies have been developed, a number of standards have also been developed. Often, the 

15 technologies and standards are constrained by requirements of backward-compatibility with 

prior standards, bandwidth limitations, current technical feasibility, and so on. As the constraints 
are relaxed or removed, new standards will continue to evolve. 

One of the substantial aspects of television standards is the definition of the "raster", the 
sequence of scan lines that form the image, including ancillary information that may be 

20 embedded in the non-visible portions of the totality of scan lines that form each image frame. 
FIGs. 1 and 2 illustrate example components of the definition of a raster. FIG. 1 A illustrates an 
example timing diagram of the major timing events within a raster line, corresponding 
substantially to the SMPTE 240M standard, and the BT.709 1 125/60 standard. FIG. IB 
illustrates the same timing events within a raster line corresponding substantially to the BT.709 

25 1 125/50, and the ITU-R BT.l 120 1250/50 standard. Each of these timing diagrams illustrates the 
flanking of a video portion 120 by a set of synchronization signals 1 10, 130. A display device 
uses these synchronization signals to maintain the proper correspondence between the beginning 
of each transmitted video line and the start of each displayed video line (horizontal 
synchronization). Because the relative timing of events differs between standards, as illustrated 

30 in FIGs. 1 A and IB, scan lines that are encoded using one standard will not be properly 
displayed by a device that is configured to conform to another standard. 
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In like manner, a series of synchronization sequences are also provided before and after 
each transmitted video frame, to maintain the proper correspondence between the beginning of 
each frame and the top of each displayed image frame (vertical synchronization). The sequences 
forming the vertical synchronization contain other specific timing events within the raster line, 
5 not illustrated in FIG. 1, to distinguish these sequences from the active video portions of each 
frame, and to provide signaling that is useful for dynamic threshold control and other 
enhancements. As with the horizontal synchronization, frames that are encoded using one 
standard for vertical synchronization will not be properly displayed by a device that is 
configured to conform to another standard. 
10 FIGs. 2A and 2B demonstrate differences between standards at the frame level. In FIG. 

2 A, representative of the SMPTE 260M standard, a frame comprises 1 125 scan lines. In FIG. 
2B, on the other hand, representative of the ITU-R BT.l 120 1250/50 standard, a frame 
O comprises 1250 scan lines, 

C§ Conventional raster generators typically operate by maintaining two counters, for the 

Vz 15 horizontal and vertical image dimensions. By adjusting the speed and range of the counters, the 

^ v : 

CO refresh rate and the resolution can be controlled. Synchronizing events, including the horizontal 

t ^ 

fS and vertical synchronization and blanking, are derived by comparing the content of the counters 

* with programmable reference values. The programmed parameters for producing the event 

is; 85= 

fij timing of FIG. 1 A, for example, would be the reference value set of {44, 192, 21 12, 2156, 
K 20 2200} , corresponding to the illustrated event transition times, whereas the programmed 
G parameters for producing the event timing of FIG. IB would be the reference value set of {64, 
256, 2176, 2240, 2304}. Similarly, the reference value sets for the vertical synchronization 
illustrated in FIGs. 2Aand2B would be {41,558,603, 1121, 1125} and {45,621,670, 1246, 
1250}, respectively. Note, however, that the use of such counters and reference values sets is 
25 feasible only if the format of the raster of each standard is substantially similar, differing only in 
the timing of each event. The different synchronization schemes for processing, for example, the 
interlaced and progressive images required by the ATSC standards for television, and the VESA 
standards for CRT related displays, do not lend themselves to this counter-reference timing 
scheme for generating the required raster for each. 

30 
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BRIEF SUMMARY OF THE INVENTION 
An object of this invention is to provide a raster generation system and method that can 
be configured to provide raster signals corresponding to existing and future television and 
display standards. A further object of this invention is to provide a raster generation system and 
5 method that is freely programmable to generate all possible rasters and synchronizing patterns 
found in the current graphics and HDTV environment. A further object of this invention is to 
provide a generation system and method that is capable of generating separate as well as 
embedded synchronization information. 

These objects and others are achieved by providing a raster generator that sequences 

10 through a list of line descriptors. The line descriptors include a line-count parameter and a line- 
type parameter. The line-type parameter defines the characteristics of each type of raster line, 
and the line-count parameter defines the number of lines of this type occurring in the sequence 
of lines that define the entire video or image frame. For efficient encoding, the characteristics of 
each type of raster line is defined in terms of a list of raster pattern types, each raster pattern type 

15 being further defined in terms of a sequence of specified durations of particular raster values. 
The raster generator sequences through the lists of line descriptors, raster patterns, and duration- 
value pairs, in a nested fashion, thereby generating the frame raster pattern as a sequence of 
individual raster values that occur for specified durations within each frame. In a preferred 
embodiment, the raster generator includes a programmable memory for containing each of the 

20 parameters that define raster. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
The invention is explained in further detail, and by way of example, with reference to the 
accompanying drawings wherein: 

FIGs. 1A and IB illustrate example timing diagrams of a raster line corresponding to an active 
video line in accordance with prior art standards. 

FIGs. 2A and 2B illustrate example frame structures corresponding to a video frame in 
accordance with prior art standards, 

FIG. 3 illustrates an example block diagram of an encoder that provides a composite video signal 
for displaying an image in accordance with this invention. 

FIG. 4 illustrates an example data structure for storing the parameters associated with raster 
generation in accordance with this invention. 

FIG. 5 illustrates an example block diagram of a raster generator in accordance with this 
invention. 

FIG. 6 illustrates an example flow diagram of a raster generator in accordance with this 
invention. 

FIG. 7 illustrates an example partial encoding of raster generation parameters in accordance with 
this invention. 

FIG. 8 illustrates an example partial raster generation corresponding to the example parameter 
encodings of FIG. 7. 

Throughout the drawings, the same reference numerals indicate similar or corresponding 
features or functions. 
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DETAILED DESCRIPTION OF THE INVENTION 
FIG. 3 illustrates an example encoder 300 that provides a composite video signal for 
displaying video images from a source 10 to a display 20. As illustrated, the encoder 300 
receives the video images from a digital video source 10, such as a DVD reader, an MPEG 
5 decoder, a computer system, and so on, and provides analog signals in a form that is compatible 
with a conventional display 20, such as a television receiver, a monitor, and so on. As will be 
evident to one of ordinary skill in the art, the encoder 300 may be used in other applications as 
well For example, the encoder 300 may be used to provide a composite video signal to a 
transmitter that is configured to transmit the signal to a conventional display, or to provide the 

10 composite signal to a device that is configured to store and/or process composite video signals. 
The example encoder 300 includes a picture element (pixel) datapath 310, a raster 
generator 320, a clock 330, and a raster definition 400, The datapath 310 is configured to provide 
the sequence of video information items corresponding to each active (displayable) line of the 
image, and the raster generator 320 is configured to augment the video image with the required 

15 raster synchronization and format to allow the active lines of the image to be displayed properly. 
The raster generator 320 and datapath 310 may also be configured to provide ancillary 
information, such as teletext, or calibration signals, to be included in the composite signal that is 
communicated to the display 20. 

In accordance with this invention, the raster generator 300 provides the required raster 

20 signaling by processing parameters contained in the raster definition 400. In a preferred 

embodiment, the raster definition 400 is contained in a programmable memory, although any of 
a number of alternative embodiments are feasible. For example, the raster definition for a variety 
of raster formats may be precoded in a memory area an integrated circuit, and the appropriate 
raster definition is selected via a format switch (not illustrated). The format switch may be 

25 externally controllable, or it may be preset during manufacturing to produce encoders of each 

specific format. By using a directly programmable memory, wherein each parameter of the raster 
can be programmed into the encoder 300, the encoder 300 can be freely programmable to 
accommodate the use of existing or new standards, after the manufacture of the encoder 300. 
Also, by allowing each parameter of the raster generation to be programmable, the responsibility 

30 of the manufacturer of the encoder 300 for directly supporting multiple raster standards is 
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substantially eliminated, allowing design resources to be allocated to activities that are 
potentially more profitable. 

FIG. 4 illustrates an example data structure for storing the parameters of the raster 
5 definition 400 in a preferred embodiment of this invention. This invention exploits the repetitive 
nature of a raster, while still allowing for detailed customization. This is effected via a list of line 
descriptors 410 that define each raster line within the raster. Recognizing the repetitive nature of 
a raster, the line descriptors in the list 410 include a line-count parameter 412 that specifies how 
many lines of the same type are contiguously repeated. Thus, for example, the raster description 
10 of the 5 17 lines of active video 202 in FIG. 2 (558 minus 41) would comprise a single entry that 
includes a line-count value of 517, and a definition of the raster line structure for each of these 
lines. A unique raster line structure can similarly be included, merely by specifying a line-count 
of one. 

Any number of techniques may be used to define the raster line structure for each line- 

15 count in the list 410. In a preferred embodiment, recognizing that some line structures may occur 
at multiple non-contiguous locations in the raster, the list 410 is structured to contain a line-type 
indicator 41 1, or pointer. This line-type 41 1 points to a definition of the raster line structure 
within a set of raster line structures 420 for each unique line-type 411, thereby allowing multiple 
non-contiguous raster lines of the same type to be encoded in the list 410 via the use of the same 

20 value as their corresponding line-type 411. 

Similarly, any number of techniques may be used to define the raster line structures 420 
of each line-type 41 1. In a preferred embodiment, recognizing that some line structures may 
contain similar patterns in parts of the raster line, the structure of each line-type is defined as a 
sequence of raster patterns. For example, the horizontal blanking pattern of each line in the 

25 active video field 202 of FIG. 2A may be identical to the horizontal blanking pattern of each line 
in the vertical blanking field 203. This identical pattern in each line is preferably encoded by 
pointing to the same pattern of sequences within a list of sequences 430, rather than explicitly 
encoding the details of each pattern of sequences each time the pattern appears within a raster 
line structure 420 corresponding to each line-type 41 L 

30 In like manner, any number of techniques may be used to define the pattern of sequences 

430 of each pattern pointed to by the entries 421 in the line structures 420. In a preferred 
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embodiment, each pattern sequence 431 is defined by a sequence of duration-value pairs that 
identify a signal value 435, and the duration 434 that that signal value 435 is to be applied in the 
raster. The value parameter 435 may be an encoding of the actual signal value, or a pointer to a 
value array 440. In a preferred embodiment of this invention, the value parameter 435 includes 
5 specific bit assignments that provide control of the raster process. For example, the most 
significant bit (MSB) of the value parameter 435 controls a switch that determines whether a 
synchronizing signal is applied, or whether the actual video is applied. That is, for example, with 
reference to FIG. 3, the MSB of the value parameter 435 determines whether the display device 
20 receives information from the pixel datapath 3 10 or the raster generator 320. In this example, 
10 if the MSB indicates that synchronizing data is to be provided, the remaining bits indicate the 
value of the synchronizing information, by pointing to entries in the value array 440. Other 
means of effecting control via bit values of the value parameter 435, or other parameters, will be 
O evident to one of ordinary skill in the art. For example, the bits in value parameter 435 may also 
CI control whether the synchronization is provided as an embedded signal within the video stream, 
|Jf 15 such as used in conventional broadcast television and interfaces from VCRs and video cameras, 
10 or whether the synchronization is provided as an external signal, such as used by High- 
X Definition (HD) protocols and interfaces such as an RGB or VGA input from a computer, 
f By defining each pattern as a sequence of signal values for specified durations, virtually 

f y any raster pattern can be encoded at a level of detail that is defined by the resolution of the 
Sri 20 duration and value parameters. By arranging this detailed information in a hierarchical linked 
O list, the memory requirements for the encoding of this detailed information for the entire raster is 
minimized. 



FIG. 5 illustrates an example block diagram of a raster generator 500 that is configured to 
25 use the example raster definition 400 in accordance with this invention. Note that the example 
structure of the definition 400 includes three levels of hierarchy (410, 420, 430), and optionally a 
fourth level (440). Fewer or more levels of hierarchy may also be employed, and the 
corresponding restructuring of the generator 500 to process different hierarchies will be evident 
to one of ordinary skill in the art in view of this disclosure. 
30 The generator 500 includes a line sequencer 510 that sequences through the line 

descriptor list 410, a pattern sequencer 520 that sequences through the line pattern lists 420, a 



701087 PATENT APPLICATION 



7 



1 December 2000 



raster sequencer 530 that sequences through the duration-value lists 430, and a signal generator 
540 that asserts the signal values corresponding to the duration and value parameters from the 
select pattern sequence in the list 430. 

FIG. 6 illustrates an example flow diagram of the raster generator 500. For ease of 

5 understanding, the invention is presented with reference to both FIGs, 5 and 6. For convenience 
in referencing, the elements of FIG. 6 each begin with the numeral 6. 

The line sequencer 510 sequences through the entries in the line descriptor list 410, 
corresponding to the loop 610-619. Feedback is provided from the pattern sequencer 520, 
discussed further below, to notify the line sequencer 510 when each line is completed. As 

10 discussed above, the line descriptor list 410 includes a line-count parameter (412 in FIG. 4) that 
corresponds to the number of repeated lines within the frame. The line sequencer 510 uses the 
line descriptor list 410 to select a specified line pattern, based on the line-type parameter (41 1 in 
FIG. 4), and maintains that selection for the specified line-count, as illustrated by the loop 620- 
629 of FIG. 6. For ease of reference, the selection of a pattern in the line pattern list 420 is 

15 indicated as coming directly from the line descriptor list 410, although typically the line-type 
value 411 will be read from the list 410 by a controller (not illustrated), and the controller effects 
the indicated selection from the list 420. This convention is also used with regard to the lists 220 
and 230. At the end of the list of line descriptors 410, the line sequencer 510 repeats the 
processing of the list 410, via a repeat of the loop 610-619. 

20 The pattern sequencer 520 sequences through the entries in the pattern list 420 

corresponding to the selected line pattern, based on the line-type parameter 41 1 of the currently 
addressed line descriptor in the list 410, as indicated by the loop 630-639. Feedback is provided 
from the raster sequencer 530, discussed further below, to notify the pattern sequencer 530 when 
each pattern sequence is completed. Each pattern identifier within the selected line pattern 

25 effects a selection of a pattern sequence of duration-value pairs in the pattern sequence list 230. 

The raster sequencer 530 sequences through the duration- value entries in the sequence 
list 430 corresponding to the selected pattern, based on the currently addressed pattern pointer in 
the list 220, as indicated by the loop 640-649. Feedback is provided from the signal generator 
530, discussed further below, to notify the raster sequencer 530 when each duration is 

30 completed. 
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The signal generator 540 effects the generation of the specified raster value for the 
specified duration. As noted above the raster value may be a specified value, such as a specified 
voltage level, or a specified control state, such as a state that determines whether the sync value 
or the pixel value is asserted for the specified duration. For convenience, the term signal value is 
5 used herein to include both control states and actual values. The signal generator 540 includes a 
timer (not illustrated) that is initiated at the start of each duration-value assertion interval, at 650. 
The generator 540 asserts the specified value or state until the specified duration has elapsed, at 
660-670. 

Upon completion of the specified duration, the signal generator 540 notifies the raster 
10 sequencer 530, and in response, the raster sequencer 530 progresses to the next duration-value 
pair in the selected pattern. When the raster sequencer 530 reaches the end of the sequence of 
duration-value pairs comprising the selected pattern, the raster sequencer 530 notifies the pattern 
sequencer 520. In response, the pattern sequencer 520 progresses to the next identified pattern in 
the selected line. 

15 When the pattern sequencer 520 reaches the end of the sequence of patterns that define 

the currently selected line, the pattern sequencer 520 notifies the line sequencer 510. The line 
sequencer 510 advances its line counter, and, if the specified line-count of the current entry in 
the line descriptor list 410 is reached, the line sequencer 510 advances to the next entry in the 
line descriptor list 410. When the line sequencer 510 reaches the end of the list 410, it cycles 

20 back to the start of the list 410, and the entire process is repeated. 

Note that, because each level of the hierarchy is configured to notify the next higher level 
of the completion of its specified raster sequence, it is the lowest level detailed description that 
determines the timing of each event in the raster. Thus, the achievable resolution is only limited 
by the resolutions achievable by the lowest level description. In this manner, virtually any raster 

25 definable by this hierarchical construct of lower level details. 

FIG. 7 illustrates an example partial encoding of raster generation parameters in 
accordance with this invention, and FIG. 8 illustrates an example partial raster generation 
corresponding to these example parameters. The parameters are contained in an example line 
30 descriptor list 41 0 ! , an example line pattern list 420', an example duration- value list 430', and an 
example value list 440', 
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The line descriptor list 410' indicates that the raster comprises five lines of line-type 2 
(reference items 711, 712), one line of line-type 4, fourteen lines of line-type 6, 537 lines of line 
type 1, and so on. FIG. 8 illustrates the sequence of five line-type-2 lines (L2) 811, one line- 
type-4 (L4) 812, and so on, corresponding to the parameters in the line descriptor list 410'. 

5 The lines of line-type-2 (711) are described in the line pattern list 420' as comprising a 

sequence of pattern 4 (721) - pattern 2 (722) - pattern 4 (723) - pattern 2 (724). Each of the five 
lines of line-type-2 comprise this p4-p2-p4-p2 sequence, as illustrated by reference items 821- 
824 in FIG. 8. In like manner, each of the lines of line-type- 1 comprise a sequence of p4-p3; 
lines of line-type- 3 comprise a sequence of p4-p2-p4-pl; and so on. 

10 Each pattern is described in the duration-value list 430 1 . As illustrated, for example, 

pattern 2 (722) comprises a signal-value-0 (73 lv) for a duration of 879 (73 Id) time units, 
followed by a signal-value-3 (732v) for a duration of 43 (732d) time units. In this example, the 
signal value parameters are pointers to the value list 440', such that a signal-value-0 (73 lv) 
corresponds to an actual magnitude value of -255 (831), while a signal-value-3 (732v) 

15 corresponds to an actual magnitude value of -200 (832). These values 83 1, 832 are indicated on 
the timing diagram line of FIG. 8. Note that in this example encoding, a negative signal value 
parameter 739 in the duration- value list 430' indicates the aforementioned pixel-value-selection 
state of the raster generator. For the duration of this control state, the actual video data is applied, 
as indicated by the reference 839 in FIG. 8. 

20 The encoding of the parameters in the lists 430-440 includes the traditional tradeoff 

between resolution and available memory space. In a preferred embodiment of this invention, 10 
bits are allocated to the duration parameter, wherein a unit duration is equal to one clock cycle, 
thereby allowing the duration to be set with a high degree of resolution. If the desired duration 
exceeds 10 bits, additional duration-value pairs are used, as illustrated by the dual 959 durations 

25 738 in the list 430' to achieve a duration of 1918 clock cycles. Similarly, 9 bits are allocated for 
storing values in the value list 440', and four bits are allocated to the value pointer in the 
duration- value list, allowing up to sixteen different values. If, as in the example of FIG. 7, the 
MSB or sign bit is used to indicate a control state, only eight different values in the list 440' can 
be addressed. The eight possible negative values of the four bit value pointer can be used to 

30 convey information to other components of the system, such as an indication of whether video or 
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teletext information is to be inserted during this interval, and so on. Alternative encoding 
schemes will be evident to one of ordinary skill in the art in view of this disclosure. 

Thus, as illustrated, any raster pattern can be defined by a sequence of duration-value 
pairs, any line can be defined as a sequence of raster patterns, and any raster can be defined as a 

5 sequence of lines. As with the duration- value list 430 of FIG. 4, the lists 410, 420 are allocated 
bits for each parameter based on an allocation of available memory. In a preferred embodiment, 
four bits are allocated to the line-type parameter, allowing sixteen different line types, and ten 
bits are allocated to the line-count parameter, allowing for a repetition of up to 1024 lines of the 
same type. The list 410 is structured to contain up to 16 line descriptor entries, a line-count value 

10 of zero is used to indicate the logical end of the list 410. The list 410, containing the description 
of the sixteen different line types, is configured to allow up to eight patterns to describe each 
line. Three bits are allocated for referencing each pattern, thereby allowing up to eight different 
patterns in the list 430. Each pattern in the list 430 may contain up to four duration-value pairs. 
These bit allocations are provided as an allocation that the inventor has found to be well suited 

1 5 for the encoding of existing and anticipated raster structures; alternative allocations may be used, 
depending upon available memory resources, and/or other anticipated raster formats. 

The foregoing merely illustrates the principles of the invention. It will thus be 
appreciated that those skilled in the art will be able to devise various arrangements which, 

20 although not explicitly described or shown herein, embody the principles of the invention and 
are thus within its spirit and scope. For example, the encoder 300 is preferably embodied in 
hardware, with a programmable memory for loading and storing the raster parameters. However, 
as processing speeds continue to increase, the encoder 300, or parts of the encoder 300, may be 
embodied in a software-based application. In like manner, a combination of hardware and 

25 software may be used. The pattern and raster sequencers 520, 530 and the signal generator 540, 
and their associated lists 420, 430 may be hardware devices, while the line sequencer 510 and 
line descriptor list 410 may be software or firmware modules. These and other system 
configuration and optimization features will be evident to one of ordinary skill in the art in view 
of this disclosure, and are included within the scope of the following claims. 

30 
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